Wavelet Neural Networks Are Asymptotically Optimal Approximators for Functions of One Variable

| Neural networks are universal approximators. For example, it has been proved (Hornik et al) that for every " > 0, an arbitrary continuous function on a compact set can be "?approximated by a 3-layer neural network. This and other results prove that in principle, any function (e.g., any control) can be implemented by an appropriate neural network. But why neural net-works? In addition to neural networks, an arbitrary continuous function can be also approximated by polynomials, etc. What is so special about neural networks that make them preferable approximators? To compare diierent approximators, one can compare the number of bits that we must store in order to be able to reconstruct a function with a given precision ". For neural networks, we must store weights and thresholds. For polynomials, we must store coef-cients, etc. In the present paper, we consider functions of one variable, and show that for some special neurons (cooresponding to wavelets), neural networks are optimal ap-proximators in the sense that they require (asymptotically) the smallest possible number of bits.